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ABSTRACT 

Educational outputs are defined as the direct end 
products, events or conditions that result ficm facilitation and 
production processes within educational institutions. The conceptual 
framework for education outcomes developed hy the National Center fox 
Hiqher Education Management Systems (SCHZiiS) is explained. The hasic 
elements oj. any educational outcomes are discussed, fcllcved by a 
presentation of other factors important fcr an in-depth understanding 
of particular educational outcomes. Six elements identified as 
critical to defining and differentiating amcng educational outcomes 
are: output/impact (degree of directness which characterizes the 
relation between educational process ard educational impact); form 
(mode or fashion in which the outcCEe is cbserved) ; measureability 
(degree to which the outcome can be guantit atively descrited); change 
status (degree of modification of the status que associated with the 
outcome); focus (basic entity that is affected by outcome); and 
neutrality (value-frea character of educational cutccires). Outside 
factors associated with educational outcomes relate to the 
pi:oducer/f acilitator, audience, interticr, functional area, and time 
of outcome. (SPG) 
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A CONCEPTUAL FRAMEWORK FOR EDUCATIONAL OUTCOMES 



Introduction 

Let us examine a hypothetical scenario. James Green received a degree 
in business administration froia Alpha College in the mid 1960s. He had spent 
five years at the college — three as a full-time student and two more as a 
part-time evening student. During that time, Jim was exposed to a variety 
of opportunities and experiences that not only increased his knowledge and 
skills, but also affected his values, relationships with peers, and other 
personal characteristics. He was sophomore class representative to the 
student senate, and later served as the president of the college's business 
students club. Jim was the first in his family to receive a college degree, 
and that achievement had an impact on his parents' social status. It also 
strengthened the determination of his younger sister and brother to attend 
college, which they eventually did. 

Shortly after graduating from Alpha, Jim joined a firm headed by a 
classmate's father. He enjoyed good pay, status, security, and excellent 
opportunities for advancement. The company benefited from Jim's college- 
enhanced abilities, and his ideas led to significant operating economies. 
One year after graduation, Jim married Barbara Smith, whom he had met while 
attending Alpha College. Barbara also graduated from Alpha and after some 
graduate training, successfully pursued a career in nursing. At the same 
time, with encouragement from his company through released time, Jim was 
completing the masters degree program in management science that Alpha 
offered. They both appreciated the security that their professional status 
permitted. Later, as parents of two children, they came to the realization 
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that their college experiences were affecting the way that they related 

to their children — for example, they made greater attempts than would otherwise 

have been the case to instill openness to new ideas, a respect for others 

no matter who they might be, and a desire to seek out new situations and 

be adaptable. 

Jim participated in civic and community affairs, partially because of 
an interest stimulated by a government course he had taken as an undergraduate 
at Alpha College. He served on the local school board, the city council, 
and the board of a local bank. He was also active in several professional 
associatji.. .IS, made numerous state and national presentations, and eventually 
became a national officer of one group. Jim continued to support Alpha 
College financially through its alumni fund aad served as an alumni contact 
for prospective students interested in Alpha's business programs. In addition, 
because of the civic and professional contacts he made, he served as a 
consultant to the U.S. Commerce Department and several foreign governments, 
relating to the development of efficient management information systems. 

It is obviously difficult to separate che effects of his Alpha College 
experiences from other factors impinging on the life of James Green. Furthermore, 
Alpha College not only affected him directly but also, through him, apparently 
impacted many others, including his parents, his brother and sister, his 
fellow students, his wife and children, his company, his city and various 
community and civic organizations. Alpha College itself, his professional 
associates, his state, his country, and even foreign countries. In addition 
to impacts through students like Jim, Alpha College also was directly 
affecting groups, communities, and individuals who were not students, through 
research conducted by the faculty, an extension advisory service, a day-care 
program set up for working mothers, weekend gymnasium privileges for community 
youth, a concert series for the community, goods and services purchases from 



local businesses, and similar activities. 

Educational-outcome scenarios of this kind could be developed for any 
college or university, and for elementary and secondary education as well. 
This example was generated using a conceptual framework for educational outcomes 
developed in recent years at the National Center for Higher Education Management 
Systems (NCHEMS) . Work on this framework took into account the fact that 
although most people have an intuitive idea of what an educational outcome 
is, widely different concepts of outcome appear in the literature and else- 
where. Outcomes have been equated by some to such conceptually different terms 
as efficiency, productivity, effectiveness, benefits, output level, value 
added, impacts, and perfotTiance, There did not appear to be a generic con- 
ceptual framework that defined educational outcome in a generally accepted and 
operationally useful manner. Therefore, NCHEMS staff began in 1974 to synthesize 
the extensive literature pertaining to the issue (Lenning 1977b) and to 
develop a framework that would have general acceptance throughtout postsecondary 
education. This conceptual framework became the basis for the NCHE^^S Outcomes 
Structure, a three-dimensional system for organizing outcomes information for 
purposes of classification, analysis, and decisionmaking (Lenning, Lee, Micek, 
and Service 1977; Lenning 1977a), 

rne remainder of this paper explicates the conceptual framework for 
educational outcomes developed at NCHEMS. Although it was specifically 
developed with postsecondary education in mind, the framework may also be 
relevant to educational outcomes at other levels. The basic elements of any 
educational outcome are discussed first. This is followed by a presentation 
of other factors important for an in-depth understanding of particular edu- 
cational outcomes. 



The Concept of Educational Outcomes 

The approach taken with respect Co defining a general and operationally 
useful concept of educational outcomes was to identify the basic attributes 
and characteristics of any such outcomes. Six such elements were identified 
as critical to defining and differentiating among educational outcomes, and 
each has been given a descriptive name as shown below: 

1. Output/Impact - the degree of directness which characterizes the 
relation between educational process and educational outcome. 

2. Form - the mode or fashion in which the outcome is observed. 

3. Measurability - the degree to which the outcome can be quantitatively 
described - 

4. Change Status - the degree of modification of th-* status quo 
associated with the outcome, 

5. Focus the basic entity that is affected by the outcome. 

6. Neutrality - the value-free character of educational outcomes. 
These elements are elaborated u-^on below. 

1. Output/Impact . A major problem is that educational outputs have 
generally not been clearly distinguished from educational Impacts. 
Failure to make a clear conceptual distinction between outputs and 
impacts reduces our ability to identify, organize, and analyze the 
wide range of educational outcomes. Both concepts are very important 
and each is a type of outconie. However, as policy analysts have found 
in other types of institutions and organizations (for example, 
Easton 1965; Robinson and Majak 1967; Cook and Scioli 1972; and 
Dye 1975) , it is essential that outputs and impacts be distinguished 
from one another. 
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Educational outputs are the direct end products, events, or conditions 
that result from facilitation and production processes within educational 
institutions. Examples of outputs at the college level are achievement levels. 
Knowledge, degrees, program completers, publications, cultural or entertainment 
events sponsored or provided, and scientific or artistic advances. Educational 
impacts , on the other hand, are the indirect products, events, or conditions 
that result from educational outputs and earlier educational impacts. Examples 

cf college impacts are greater individual incomes resulting fro^ college degrees, 

higher standards of living resulting from the increased income, and a larger 

gross national product resulting from higher standards of living. The primary 

distinction between outputs and impacts is whether or not the outcome can 

be directly linked, at least in concept, to basic institutional and programmatic 

activities. Outputs may be referred to as first-order consequences , signifying 

a direct link to institutional or program activities. Similarly, impacts 

may be considered second-order consequences , because the links to institutional 

or programmatic activities are indirect, either through an output (or more 

than one output) or through the output (s) plus a chain (or chains) of earlier 

impacts that resulted from the outpuc(s) . 

Conceptually, the distinction between outputs and impacts is quite 
straightforward. In practice, however, things become rather complex and 
difficult. First, it is often impossible to ascertain cause-and-ef feet 
relationships between educational resources, ctivitxes, and outcomes, even though 
many such relationships have been hypothesised^and some have been demonstrated. 
Second, from one perspective an outcome may be viewed ai^an- putjut of an 
activity, and from another perspective it could be viewed as an impact of 
the same activity----for example, the development of student leaders might be 
seen as an output of the institution and as an impact of different programs 
within the institution. Third, any presumed output can be divided into components 
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that must occur before the overall output can occur. This introduces 
complexity into the determination of whether a particular outcome is an output 
or an impact. Referring to the example above relating to the development of 
student leaders, the component skills and abilities that make up leadership 
ability — ability to organize, empathize, speak fluently, motivate people, etc. — 
are outputs, and they lead to the overall ability to lead. They must be in- 
tegrated within a person, however, before the overall ability to lead is 
present . 

A related problem is that some entities conceived of as outputs and impacts 
are seen as inputs by others. Thus, some would consider a curricular program 
to be an output, while others would consider it to be a producing/facilitating, 
activity that leads to outputs like student skills and knowledge. The same fs 
true of the development and build-up of library and other instructional resources, 
including those being developed by faculty. For the resource developers on a 
campus, this development could logically be considered an output. The instructor 
using those resources could, on the other hand, viev them as strictly inputs 
to the instructional process, and not as outputs. 

It should be recognized that an impact is not only less direct than 
an output, but often is less immediately realized. An output occurs during 
or at the end of the process bringing it about, while an impact can occur during 
or at any time after the process ends. Therefore, educational institutions 
generally have much less control (if any) over impacts than they have over 
asspciated outputs of the institution. Although significantly positive 
correlations between amount of college education and income earned have been 
noted in the research literature, income is probably affected more by prevailing 
economic conditions and other postgraduate factors than by the colle.ie 
attended. Few college officials would claim that their institution has 
direct, immediate control over such an outcome. 




In siHDinary, outcomes are either outputs or impacts, and a particular 
outcome may be considered either when viewed from different perspectives. 
Some outcoraes are definitely impacts, however, no matter who within the 
institution is viewing them; and it is important for planning purposes to 
consider them as such. Furthermore, thinking in teras of both outputs and 
impacts can help one to generate more comprehensive lists of particular kinds 
of educational outcomes, once the perspective from which one is viewing 
outcomes is clarified. To reach consensus on whi^h outcomes should be 
considered outputs and which are impacts, it is essential that the unit 
of analysis ^ made clear (the outcome-produccion level on which attention 
is to be fixed, e.g., course, program, institution, system of institutions). 
Form . The work of Schalock and his associates (''^72) makes it clear 
that both outputs and impacts can take any one cf three forms: 
product is a concrete entity that endures with time, such as e program 
completer, a degree, a job, a book, cr an invention. An event is 
an observable, tangible transaction or set of behaviors that does not 
endure with time, such as a public seminar, a concert, or a graduation 
exercise. A condition is an intangible circumstance or set of 
circumstances, such as morale, satisfaction, an attitude or belief, 
an appreciation, social equity, or achievement. As with the output-impact 
distinction, thinking about kinds of outcomes in terms of produces, 
events, and conditions can be useful for generating lists of specific 
outcomes, for developing measures or indicators of those outcomes, and 
for analyzing outcomes information. 



Measurability , The ease with which particular outcomes of an 
educational institution or program can be quantified or measured is 
related to the tangibility or concreceness of its form. However, 
maasurability is not synonymous with tangibility or concreteness . 
For example, abstract and intangible constructs Chat are often 
considered to be outcomes of <i college education — analytical ability, 
reading comprehension, vocational readinesss, and various aptitudes — 
can be measured in quantifiable terms. 

Determining whether specific outcomes and types of outcomes are easy 
or difficult co measure, and asses:.ing the validity and reliat^ility 
of their measures, can contribute to a better understanding of those 
outcomes and to any analyses that are done of them. Gross (1973) , for 
example, has broken outcome goals for five target populations (society, 
individuals, employer, government, and institutions) into those that 
are easy to measure and thosa that are difficult to measure. One 
problem here is that what is easy to measure in the view of one person, 
based on the availability of a particular measure, may be considered 
difficult -o measure by another person who considers that measure to 
be invalid. In addition, as technological advances in the measurement 
field cGCur, some outcomes currently considered difficult to measure 
may become easier to measure. 

Change Status . Another important characteristic of educational 
outcomes is whether they are concerned with maintenance or change. 
Maintenance involves stabilization, reproduction, preservation, or 
other status quo outcomes. Examples include the continuation of 
traditions into the next generation, preservation of cultural values, 
restoration of community artifacts and paintings throuj^h guidance from 
university art students, skill maintenance provided by in-service 



education, or maintenance of the educational level of a family. 
Conversely, change involves modification, revision, replacement 
or other alteration of the status quo. Examples include achievement 
of a college degree, greater economic and social mobility, increased 
knowledge and skill level, new art forms developed by college graduates, 
technological innovations, or medical discoveries. Derivation of 
these categories is based on the work of Derr (1973) and Parsons 
''1951). All educational outcomes can be thought about in these 
terms. Educational goals are designed either to preserve, replenish, 
reproduce, and stabilize the status quo or to modify, enrich, 
restructure, revise, or replace what is currcat. 
Focus . Still another important characteristic of an educational 
outcome concerns the specific "what" on which the maintenance or change 
is focusing. For example, knowing that the outcome involves a 
change in knowledge and understanding, values, skills, habits, 
standards, economic conditions, or the gross national product is more 
useful than simply knowing that the outcome involves a change in 
status. Figure 1 presents the large array of focus categories and 
subcategories included as part of the "type-of-outcome"' dimension of 
the NCHEMS Outcomes Structure. These categories are based on work 
by a large *umber of researchers and theorists, as outlined in Lenning, 
Lee, Micek, and Service (1977, p. 27). 

Neutrality . Generically, out come is a value-neutral concept, and thu3 
educational outcomes should be thought of as being inherently neutral 
in character. Often, outcomes are equated with benefits and outcomes 
perceived to be negative in: nature are ignored. But these value 
connotations are attached by the perceiver; thev are not inherently 
part of or a characteristic of the outcomes. For planning purposes. 




Figure 1 

FOCUS CATEGORirS AND SUBCATEGO^'ES IN THE 
TYPE-OF-OUTCOME DIMENSION OF THE NCHEMS OUTCOIIES STRUCTURE^ 





Category 

Code NuTt>?f £nir/ Being Maintained or Changed 


1000 ECONOMIC 0U7C0MSS 

1100 Economic Access and Indeo^ndence- OutcofPos 
1 1 10 gcopofr.ic Access 

1 120 Econor.ic FJexi5iIi!y. Adao:aDi»ity , anc Sf>cuf ity 
1 139 Incon* and S:an02.'o of Li/.ng 

t2C0 Sconomc RcsOwfces and Ccs's 

1210 Econonijc Costs ano EiiiCsencv 

1220 £corscr^*c Resources < inc!u:i«ng empsoyees) 

1300 Econom.c Frocuc! on 

i3'iO Ecororiic P;oduc?ivi! / and Production 
1320 economic Ser/ices Proviccd 

i400 0:n5f Economic Outcomes 


2000 riUfAAU CHARACTERISTIC OUTCOMES (continued) 
2750 Power and/of Aotnority 
2770 Job. Scnool. Of Li'e Success 

2760 Other Status. R&cognition. and Certification Outcomes 

2800 Socia: Activmesand flo'es 

2310 Adjustment to Re'irement 
2820 Afftnations 

2SiO Avocational and Social Activities and Rcl<?s 
2840 Career and VccatiC/iiSi Activities and Roies 
2550 C:ti2enshioActiv*t«csand Boles 
2360 Fom:iy Activities and flcies 
2670 Friendships ar*<; Re'a'ior ships 
2380 Other Ac;:vity and Hole Outcomes 

2900 Othei" Honnan Charactpristic Outcomes 


200C HUM A N CHA RA C T^RlSVC OU TOOK'ES 

2100 Asr-raticis 

21 10 Desires. Akps. and Goa*s 
2120 D;sJik€:s, Likes, arc ^nieres;s 
2130 M.ott¥d;ion or D'»ve Le-.e' 
2140 Otne: Acpiriticnai Outccrres 

22C0 CoTpeience ano 

22' Q Acadenr-c 3x«ns 

2220 Ci!-2i»ns^'0 anc r aT.si, Mc Tf>Oe'Sn y<'iis 
2250 Cfeatr.ir/S/ifis 

22^0 £ypfes6i0n and Comrr>ur,iCati SHiils 
2250 lnte:iectu3J Skjhs 

2250 trterperscr^i. wtaCtffs'^iO ans C'rar.2at«onai Sp'iHs 
2270 OccupnliC.'»«4i a^w £''0(Cy?C'i'!/ S'". '-s 
2220 Physical a-^c Motor S-f is 
2290 Otner Skill Outcorres 

2300 f/oraie. SatisfacS'on. and AJ'ecS've Cftarac;enstics 
2?i0 A:::!vdcsa'»o Vjiues 

2320 Seme's. Corrsrr.ijrrerts. an^ P^ii^oscpr^y of Life 
2^3C F*c'ingscr>d Eno'tcn? 
23^0 Mces. Cusrom. 3rd Su^caros of Conduct 
2350 Ctrcr A'.'ei'.ve Ooico^nes 

24(X) Percsptu ;r-aracterts!.cs 

2410 f-pTuai Awareness and S'*ositwit/ 

2420 Per ,00t'cn o? Se«? 

2430 Percc'ptif n 0:^ers 

2440 Pc-'ccpt«on of T.^'.jngs 

2450 Cf>ef PercepualOu'corries 

2500 Pe'sonatttv and Fcrso'-ai Coping Cf'a'ac'erisjjcs 
2510 Adv:.n;urou5n«S arc I'^itioi ve 
2r20 Autonom / a'ld indeoendeoce 
25^ Dependao l.'y ana ^czonsitr^ut^ 
2540 Dogfr.atic/C?e«"-M r^ded, Autrontar.an/Corrocratic 
2550 P'cxi&ility and Adap:a&:i):y 
2550 Hajits 

2570 PsvcJic{OQical Fyr-ctioni^g 
2580 To'cri»ncc and Persistence 

2590 Oi •«?f Personality and Personal Coping Outcon es 

2W Physical aro Pf'ys-o'ogcal Charactcrii:.cs 
2510 Physical Fitnessand Trans 
2620 Physiologirai Hejith 
2530 Other Physical or PhysiCiog»cal OutcoT^ej 

2700 Status, P.ecognnon and Coti»ica:.cn 

2710 Complpticn cf Ach e^emisnt A^ard 
2'20 Credit O'cngnt.on 
2730 Imago. Heou!«*tion. cr SialuS 
2740 Licens'ng and Ccni'<C3t'on 

2750 OlJtaininy a Jot or AdmiSiion ro a Foncw-up Program 


30C0 fCNOW'LEDGE. TECHNOLOG f. AND ART PQRM 0U7C0MEZ 

ZlOO General Knoiviedge and Ur derstancmg 

31 10 Knowledge a-^d Understanding of General Facts and 
Terminology 

3120 Knowledge and Uiderstanding of Gene'ai Processes 
3130 Knov/ieog? ano UnrJer'^tirsding of G^no ai Theory 
3140 Other General KnoAfiedgc ana Unders'anding 
3200 Sncciaiiied Knowledge and Understanding 

3210 Knowledge ard Understanding of Sp^ciaiirod Facts 

and Terminology 
3220 Knowledge and Understanding c? Speciali2«?<: 

Processes 

3230 Knowledge and Unders;anding of Specialized Theory 
3240 Other Speciaiced Knowledge and Und;:fi>;anding 

3300 Research and Schclai'Ship 

3310 Researcfi and Scholarship ."knowledge and 

Understanding 
3320 Reseaich and Schci&rship Prodocis 

3400 Art Porms and Works 
3''10 Architecture 
3420 Oarce 
3430 Oeba:e and Oratory 
3440 Drama 

3450 Literature and V/rsting 
3460 Music 

3470 Pain'mq. 0;£w/*.ng, and Photography 
3480 Sculpture 
3490 Other Fine Arts 

3500 Other Knowledge, Technology, and An »-'crrr, Octcnrnes 


4000 RESOURCE AND SERVICE PROVlS'GN OUTCOMES 

4100 Provision of Facilities an*^ events 
41 10 Provision 0* r ac-iities 
4 120 Provision or Sponsorship of Events 

4700 P'ovision of Direct Se^^/ices 
4210 Teaching 

4220 Advisory and Analytic Assistance 
4230 Treatment, Care, and P^ferral ^^rvicos 
4240 Provision of Otr.er Services 

4300 Other Resource and Service Provision Outcomes 


5000 OTHER MAtNTCNANCE ANO CHANQE OUTCOMES 
5100 Acsthctic-Cuiturai Ac:ivtiios. Traditions, and Conditions 
5200 Organizational F orma!. Act iviiy. and Oporatton 
5300 Otr.er Maintenance and Change 



^Reprinted from Lenning, Lee, Micek, and Service (1977, p- 27). 
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in particular, the full range of outcomes and associated values 
should be considered. 

It should also be noted that individuals may differ in their 
perception of the value of a particular outcome. Even for an outcome 
generally viewed as positive in our society, there may be people who 
s<ie it as negative. The stated outcome goals in our society for schools 
and colleges are generally perceived by most people to be of positive 
value. However, Bowen (3974, pp. 14--15) , has identified a num' : 
general outcomes of college that many people consider to have negative 
value, for example, more liberal political, religious and social attitudes 
and values. 

TheGc six basic clenents together delineate our concept of educational 
outcomes in an operationally useful form. Theoretically, outcome can be characterized 
as an output or an impact ; takes a certain form ; is measurab le to some greater or 
lesser extent; is concerned with change or maintenance ; has a particular focus or 
subject; and is inherently neutral in value. Any of the rich array of outcomes 
associated with ouir ficticious James Green, for examplel^ could be categorized in 
terms of these six major characteristics. Attempting such a categorization, 
however, makes it clar that a number of factors not inherently part of educational 
outcomes nevertheless have important relationships with and effects upon those 
outcomes. These factors are reviev/ed in the next section. ' . 

Factors Related to Educational Outcomes 

Identifying the most important outside factors associated with educational 
outcomes can be seen as a process of answering a series of straightforward questions: 

Mhat activities, processes, or programs were implemented to bring about the 
outcome of concern? 



Who receives or is affected by tha outcome? 
*;hy was the outcome generation process initiated? 
^Jhere did the outcome occur? 
When did the outcome occur? 
The factors corresponding to these questions are identified in this framework as: 

1 . Producer/ facilitator 

2 . Audience 

3. Intention 

4. Functional area 

5 . Time 

1, Producer /Facilitator * Even unintended college outcomes^ are typically 
stimulated by some causative or facilitative entities or factors 
within the institution. Knowledge about the entities influencing or 
causing an outcome is critical in any attempt to identify, classify, 
or analyze outcomes, since different types and levels of programs and 
organizational units are designed to produce particular kinds of 
outputs and impacts. For example, many of the outcomes intended for 
an introductory biology course may be different from those intended 
for an advanced biology course, for a degree-oriented program in the 
biological sciences, for a biology department, or for the institution 
as a whole. 

Furthermore, what is viewed as an outcome from one viewpoint may be 
seen as an input from another perspective. For example, "graduates produced 
in college" constitute an outcome in the eyes of college officials, 
while business firms may regard these graduates as inputs. Thus 
it is necessary to link outcomes to the unit or entity that produces 
them in order to maintain a consistent perspective. Within higher 
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education, the progranmiatic activities of the college Snd its 
components have traditionally been divided into instruction, 
research, and public service. A commonly used expansion of this 
breakdown is the NCHEMS Program Classification Structure (Collier 
1978) , which includes a range of support programs and is considered 
applicable to all types of postsecondary-education institutions. 

Neither the educational process within an educational institution 
nor the associated outcomes is totally separable into a set of 
component parts. As a result, it is difficult to determine which 
units within the institution contribute to the formation of a 
particular outcome. In addition, multiple programs or other organi- 
zational units within the institutiton often contribute to the same 
outcome, and their relative contributions cannot be easily ascertained. 
Institutional and program environments (other students, atmosphere, 
reputation, and so forth) also affect the outcomes produced. Similarly, 
a wide variety of methods, techniques, and tools can interact to 
constitute the process within the program or other unit. Each 
possible combination might be expected to result in a different 
educational outcome. Finally, the characteristics of the students and 
other inputs makes a difference in the outcomes attained. In short, 
a variety of comple,:ities is associated with isolating the role of 
a specific educational producer/facilitator. Nevertheless, tu9 more 
that is known about such entities, the greater the potential for 
understanding the resultant educational outcomes. 
Audience. A second factor that affects educational outcomes is 
the identity of the persons, groups, organizations, or other entities 
tnat receive or are affected by the educational outcomes of concern. 
An educational institution has the potential to influence a large 
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number of persons, groups, and communities — plus other entities, such 
as the environment. Un the surface, this dimension may seem straightforward, 
but actually it represents a ma^or difficulty in identifying and understanding 
educational outcomes. This difficulty results from the great com- 
plexi».y characterizing the individuals, groups, and communities 
directly served or affected by the outcomes of education. For 
example, Gross (1966) identified 26 major groups interested in the 
outcomes of any social system, such as education. Figure 2 
presents oudience categories and subcategories that constitute the ^ 
audience dimension of the NCHEMS Outcomes Structure. 
Intention, Specific outcomes may or may not be intended by the 
producing and facilitating units within the institution that give 
rise to them. In particular, many of the negatively viewed educational 
outcomes (for example, increased student drug use) are not expected 
by those planning the educational activity that causes or facilitates 
them. These unintended outcomes, or side effects, may occur either 
instead of or along v;ith intended outcomes. Sometimes, previous 
experience or research may suggest that negative side effects will 
occur. One must then consider whether, the benefits of the intended 
outcomes outweigh the expected negative side effects by enoueh to warrant 
proceeding with the activity or program. However, it should not 
be inferred from this, or from the fact that intended outcomes are 
almost always viewed as being desirable, that unintended outcomes 
are always undesirable, or negative. Some of the most important and 
valued outcomes of specific programs and activities can be unintended 
side effects, for example, a program designed specifically for 
information dissemination that stimulates the formation of an or- 
ganized student action group. 



Figure 2 

CATEGORIES AND SUBCATEGORIES OF THE 
AUUIHUCE UIHENSIOH OF THE NCHEMS OUTCOMES STRUCTURE^ 

10 in<Jfw<iu9t/GroL'p ai^ftts-Thiz csioQcry refers to pwsons or Qfoupi ot pe/3on» who vo diroct cMents oif^^ postaocondary ^ucallon un!! of 
cDfwero an<J/Of !neir JmmeJiaie associaros. such as family and reiattvos or poors. - * * 

1 1 . Siotfenis-lndlviduais or groups of Indh/ldualS who currently are enrolled in th« Profifam. insutution. or sysicrn of postaocofKJory viuCiWon 

12. former Sfutfen/s-lndlviduaiS Of groups of individuals ^ho formoffy were onrclled in the program. instUution. 3r system of postsecondary 
education. 

13. Family an<i Roi9Uves ofSludsnts cr Former Stu(f€nts 

14. Peers enof >\5jcc/aies 0/ Studems or Former Studeoii 

15. Faculty 

16. Staff Oihff than Faculii 

17. Offtcr InCiyiduil/Group Chents^An example woj»d be an Individual who i4 norni ot the auova but Is scrtOd by an advUwy service offered 
by the collage. 

20. Intsr95t- Based Commun/(/fs-ThJS category refers to large groups that a/e Identified a$ enttHes working toward a weU-daf'tned imctesf cr 

21 Prmia emetpnsa Commuml/es— Communities where a maior purpose Is fmancUl remuneration and prof»t— for exarple. corporatlcns. 
smalt businesses, and farmers. 

22. -4ssocjaf/ort Com/run/(/es -Communities where members belong on irie basis of affiliation rather than employment, such as unions and 
piotessional societies. 

23. Government Commun///cs-Communmes design^ to administer government regulations and sendees. Such as cUy^Wall. V^ie department 
of educatJcn. ano legislative Communities. _ 

24 Nongoy/etnmental/Pubiic Semct Communities Other than the institution Producmg tne Oufcome-Nonproflt sen/ico organlzat.ons. such 
as schools, hosoitats. welfare ageocios. phManthiopic lo«ndat.ons. colleges (other than the college producing the outcome^, and rese^Cf*. 
organizations. / 

25 institution or inztitutionol Untt Producing the Ou/come-The postsecondary education institution and/or units within that mstiluticn that 
are oerceived as the producer /facilitator of the outcome(s) of concern. 

26. Other Interest-Based Corr,mumties-An example vrould be an ad hoc coalition task force of representatlrtS from two or rrcre of tneabova 
areas. 

30. GecgraotiiC'Based Comm vn/(/es— This category refers to »a:ge groups defined on the basis of functional territorial boundanes, 

31 toca' Community— A townshio c.ty. ccunty metrooohian Aiea or other type o* locality ha/ing panicufar bounCanes it is not necessarily 
rwirictcd to the legai or jurisdictional Mundary t>u: tne functiLnai one m which the .mpact of tne institution is (or sT.ouJd be) directly and 
physicativ fel! The boundaries wnl var/ with ine institution /program ano outcome ot concern. 

32 The State 

33 A Region— An aggregation of states or parts of stales. 

34 The Nation 

35 An Internsttonat Community 

35 Other GeogtaphtcBaced Communities— An example would be a research discovery that affects pnmar.iy people living in me coldest 
latitudes, or where it snows heavily. 

40. Ag.ytpfies ol Peop/e— This category re;ors to subpoouiations of peoj<e distingut^f^^J b/ pstticuiat chararjenstics 'hat r^ay indicate common 
concfirny needs cr wants. b« - vyho do not necessarily have a common to'cresl or mission, and therefore do not constitute communities 

41. Abfiity Level Subpoou/arfons-SuboopulitionS defined according to level of .ibihly /proficiency on general intellectual furctlOAing or 
specific ski.ls— lor example, gifted, typjcal. disadvantaged, or skilled, semi-ski'led. unskilled. 

42 Aga Subpcpulathns 

43. educational Level Subpopulations 

44. tncone Level Subpopulatlons 

45. Occupation Subpcpulations 

46 PhySfcal Dtsaoility Condition Subpopulationt 

47 Pace Subpopulattons 
46 Sex Subpopulatlons 
49. Other Sucii Aggregates 

CO Ofner Au?/iences— fixampids would be ?he natural environrrent that Is affoctod by uni^rs»ty. sponsored »esearf.h (wh^ch m torn would bo 
expected to have impacts cn audiOncos such as individuals and commun»iios> and populat.ons oJ ammals (such as the snimais affected by 
efforts to keep depleted spocies frcm txxorrmg extinct or by the development of vaiwinary medlcinesi 

^Reprinted from Lenning, Lee, Micek, and Service (1977), page 24. 
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The interaction between the producer/facilitator of educational 
outcomes and the audience receiving or being affected by outcomes is 
also an important variable. Instituions supply educational goods and 
services because these are desired or demanded by various members of 
the community and larger society (or at least the institutions perceive 
a demand for the goods and services). In exchange, the institution 
and its programs receive financial and other necessary resources, 
including such nonpecuniary returns as status and praise. To be 
most effective in producing the diplomas, knowledge, skills, and 
other outcomes demanded by their clientele and funders, institutions 
need to know the costs of production and the impacts these goods 
and services will have on individuals and society. Such knowledge 
should heip'^ir^'titutions obtain greater returns on the investments 
being made in them. 
4. Functional Area . The life of any individual, group, institution, or 
community can be viewed as involving several functional areas, 
and the outcomes of educational programs and institutions impinge 
on these areas. An understanding of particular educational outcomes 
can thus be facilitated by delineating each major functional area 
affected by educational institutions and programs. Here is one 
possible breakdown of outcomes by functional area: (1) economic 
(earnings, promotions, job opportunities, labor productivity, income 
distribution, growth of the national income), (2) educational/technological 
- (degreesT^ heading habits, writing habits, educational level of 
society, advancement of scientific and techn'- ogical knowledge, 
dissemination of new knowledge), (3) political (political e»ttitudes, 
skill in evaluating political candidates, participation in civic 
activities, public policy development, election outcomes, international 
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relations; and (4) social/cultural/personal (religious attitudes 
appreciation of art, human relation skills, personality growth, 
crime rates, changes in traditional social values). 
5. Time . As Havighurst (1952) has suggested in his discussion of 

"developmental casks," certain outcomes should be expected at particular 
points in one's educational career. Outcomes are difficult to bring 
about before the recipient is ready for them. Thus the time that an 
outcome occurs can be revealing. Duration or persistence of the 
outcome is also a time-related factor that can have importance for 
analytic purposes. Some outcomes are of short term — a college football 
g=ime, for example ♦ Other outcomes are lasting, such as development 
of a vaccine for influenza in a university department of medicine. It 
should be kept in mind, however, that the dividing line between short 
term and long term depends on situation and viewpoint. One person 
could consider an outcome that persists until one year after graduating 
from college as a short-term outcome, while another person might 
consider this same outcome to be long term* The basic point is that 
both time of occurrence and duration are important for collecting data 
about educational -outcomes, in analyzing and interpreting such data^ 
and to guide planning for outcomes. 
Conclusion 

'rhe key question about the framework presented Is the extent to which 
it appears to fulfill its intended role as a generally accepted and operationally 
useful basis for understanding and describing educational outcomes. Is the 
framework conceptually complete and nonredundant? If not, what are the 
significant omissions or overlaps? Can the framework be the basis for consensus 
about the nature of educational outcomes and factors associated with their 
understanding? Can the framework effectively support operational tasks such as 
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delineating outcome possibilities, planning for outcomes, developing outcome 
measures^ analyzing and interpresting outcomes information, and conmunicating 
about the broad range of education outcomes? Preliminary evidence and 
experience (Lenning 1977a) indicate that we can give a positive response to 
these questions. However, much more questioning, testing, and development 
remains to be done. The entire arena is rich in scope and fraught with 
complexity. We hope that this paper takes a step toward untangling that 
complexity without compromising the attendant richness. 
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